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SPECIFICATION ^ 
TITLE OF THE INVENTION 
MAXIMUM A POSTERIORI PROBABILITY DECODING METHOD AND 

APPARATUS 

5 BACKGROUND OF THE INVENTION 

This invention relates to a maximum a posteriori 
probability (MAP) decoding method and to a decoding 
apparatus that employs this decoding method. More 
particularly, the invention relates to a maximum a 

10 posteriori probability decoding method and apparatus 
for implementing maximum a posteriori probability 
decoding in a short calculation time and with little 
use of a small amount of memory. 

Error correction codes, which are for the purpose 

15 of correcting errors contained in received information 
or in reconstructed information so that the original 
information can be decoded correctly, are applied to a 
variety of systems. For example, error correction 
codes are applied in cases where data is to be 

20 transmitted without error when performing mobile 

communication, facsimile or other data communication, 
and in cases where data is to be reconstructed without 
error from a large -capacity storage medium such as a 
magnetic disk or CD. 

2 5 Among the available error correction codes, it has 

been decided to adopt turbo codes ( see the 
specification of USP 5 , 446 , 747 ) for standardization in 
3rd-generation mobile communications. Maximum a 
posteriori probability decoding (MAP decoding) 

30 manifests its effectiveness in such turbo codes. A MAP 
decoding method is a method of decoding that resembles 
Viterbi decoding. 

(a) Convolutional encoding 

Viterbi decoding is a method of decoding a 

35 convolutional code. 

Fig. 9 shows an example of a convolutional encoder, 
which has a 2 -bit shift register SFR and two exclusive- 
OR gates EXOR1, EXOR2 . The gate EXOR1 outputs the 
exclusive-OR g 0 between an input and R lf and the gate 

40 EXOR2 outputs the exclusive-OR g 1 (outputs "1" when "1" 
is odd and outputs "0" otherwise) between the input and 
R 0 , R im Accordingly, the relationship between the 
input and outputs of the convolutional encoder and the 
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states of the shift register SFR in an instance where 
the input data is 01101 are as illustrated in Fig. 10, 

The content of the shift register SFR of the 
convolutional encoder is defined as its "state". As 
5 shown in Fig. 11, there are four states, namely 00, 01, 
10 and 11, which are referred to as state m 0 , state m 1# 
state m 2 and state m 3 , respectively. With the 
convolutional encoder of Fig. 9, the outputs (g 0 *gi) 
and the next state are uniquely defined depending upon 

10 which of the states m 0 to m 3 is indicated by the state 
of the shift register SFR and depending upon whether 
the next item of input data is "0" or "1". Fig. 12 is 
a diagram showing the relationship between the states 
of the convolutional encoder and the inputs and outputs 

15 thereof, in which the dashed lines indicate a "0" input 
and the solid lines a "1" input. 

(1) If "0" is input in state m 0 , the output is 00 
and the state is m 0 ; if "1" is input, the output is 11 
and the state becomes m 2 . 

20 (2) If "0" is input in state m x , the output is 11 

and the state is m 0 ; if "1" is input, the output is 00 
and the state becomes m 2 . 

(3) If "0" is input in state m 2 , the output is 01 
and the state becomes m 1 ; if "1" is input, the output 

25 is 10 and the state becomes m 3 . 

(4) If "0" is input in state m 3 , the output is 10 
and the state becomes m x ; if "1" is input, the output 
is 01 and the state becomes m 3 . 

If the convolutional codes of the convolutional 
30 encoder shown in Fig. 9 are expressed in the form of a 
trellis using the above input/output relationship, the 
result is as shown in Fig. 13, where state m ± (i = 0 to 
3) is expressed as state m = 0 to 3, k signifies the 
time at which a kth bit is input, and the initial (k=0) 
35 state of the encoder is m=0. The dashed line indicates 
a "0" input and the solid line a "1" input, and the two 
numerical values on the lines indicate the outputs (g 0 , 
g x ). Accordingly, it will be understood that if "0" is 
input in the initial state m=0, the output is 00 and 
40 the state is state m=0, and that if "1" is input, the 
output is 11 and the state becomes m=2. 

Upon referring to this lattice-like representation 
(a trellis diagram), it will be understood that if the 
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original data is 11001, then state m=2 is reached via 
the path indicated by the dot-and-dash line in Fig, 13 
and the outputs (g 0 , g x ) of the encoder become 

11 -» 10 -» 10 -» 11 -> 11 
5 Conversely, when decoding is performed, if data is 

received in the order 11 -» 10 10 11 11 as 
receive data (ya,yb), the receive data can be decoded 
as 11001 by tracing the trellis diagram from the 
initial state m=0. 

10 (b) Viterbi decoding 

If encoded data can be received without error, 
then the original data can be decoded correctly with 
facility. However, there are cases where data changes 
from "1" to "0" or from "0" to "l" during the course of 

15 transmission and data that contains an error is 
received as a result . One method that makes it 
possible to perform decoding correctly in such case is 
Viterbi decoding. 

Using a kth item of data of encoded data obtained 

20 by encoding information of information length N, 

Viterbi decoding selects, for each state (m=0 to m=3) 
prevailing at the moment of input of the kth item of 
data, whichever of two paths that lead to the state has 
the fewer errors, discards the path having many errors, 

25 thenceforth, and in similar fashion, selects, for each 
state prevailing at the moment of input of a final Nth 
item of data, whichever of two paths that lead to the 
state has the fewer errors, and performs decoding using 
the paths of fewest errors among the paths selected at 

30 each of the states. The result of decoding is a hard- 
decision output. 

With Viterbi decoding, the paths of large error 
are discarded in each state and these paths are not at 
all reflected in the decision regarding paths of fewest 

35 errors. Unlike Viterbi decoding, MAP decoding is such 
that even a path of many errors in each state is 
reflected in the decision regarding paths of fewest 
errors, whereby decoded data of higher precision is 
obtained. 

40 (c) Overview of MAP decoding 

(c-1) First feature of MAP decoding 

With MAP decoding, the probabilities cx 0 k (m) , 
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a i,k( m ) that decoded data u K is "0", "1" in each state 
(m = 0, 1, 2, 3) at time k (see Fig. 13) are decided 
based upon the following: 

(1) probabilities (^^(m), a x #k _i(m) in each state 
5 at time (k-1) ; 

(2) the trellis (whether or not a path exists) 
between states at time (k-1) and time k; and 

(3) receive data ya, yb at time k. 

The probabilities (^^(m), ^(m) in (1) above are 

10 referred to as "forward probabilities" ("forward 

metrics"). Further, the probability found by taking 
the trellis (2) and receive data (3) into account, 
namely the probability of a shift from state m' (= 0 to 
3) at time (k-1) to state m (= 0 to 3) at time k is 

15 referred to as the "shift probability". 

(c-2) Second feature of MAP decoding 
With Viterbi decoding, the path of fewest errors 
leading to each state at a certain time k is obtained 
taking into account the receive data from 1 to k and 

20 the possible paths from 1 to k. However, the receive 
data from k to N and the paths from k to N are not at 
all reflected in the decision regarding paths of fewest 
errors. Unlike Viterbi decoding, MAP decoding is such 
that receive data from k to N and paths from k to N are 

25 reflected in decoding processing to obtain decoded data 
of higher precision. 

More specifically, the probability P k (m) that a 
path of fewest errors will pass through each state 
m (= 0 to 3) at time k is found taking into 
30 consideration the receive data and trellises from N to 

k. Then, by multiplying the probability |3 k (m) by the 

forward probabilities a 0 k (m) , a x k (m) of the 
corresponding state, a more precise probability that 
the decoded data u K in each state m (m = 0, 1, 2, 3) at 
35 time k will become "0", "1" is obtained. 

To this end, the probability p k (m) in each state m 
(m= 0, 1, 2, 3) at time k is decided based upon the 
following: 

(1) the probability p k+1 (m) in each state at time 
40 (k+1) ; 

(2) the trellis between states at time (k+1) and 



- 5 - 



time k; and 

(3) receive data ya, yb at time (k+1). 

The probability P k (m) in (1) above is referred to as 
"backward probability" ("backward metric"). Further, 
5 the probability found by taking the trellis (2) and 
receive data (3) into account, namely the probability 
of a shift from state m' (= 0 to 3) at time (k+1) to 
state m (= 0 to 3) at time k is the shift probability. 
Thus, the MAP decoding method is as follows, as 
10 illustrated in Fig. 13: 

(1) Letting N represent information length, the 

forward probabilities a 0 k (m) , a 1#k (m) of each state (m « 
0 to 3) at time k are calculated taking into 
consideration the encoded data of 1 to k and trellises 

15 of 1 to k. That is, the forward probabilities a 0 k (m) , 

a i,k( m ) of each state are found from the probabilities 

a o,k-i( m )' a i.k-i( m ) and shift probability of each state at 
time (k-1 ) . 

(2) Further, the backward probability |3 k (m) of 
20 each state (m = 0 to 3) at time k is calculated using 

the receive data of N to k and the paths of N to k. 

That is, the backward probability fMm) of each state 

is calculated using the backward probability P k+1 (m) and 
shift probability of each state at time (k+1). 
25 (3) Next, the forward probabilities and backward 

probability of each state at time k are multiplied to 
obtain the joint probabilities as follows: 

X o k (m) = a ok (m) -p k (m) , 

X 1 k (m) = a 1JC (m) -p k (m) 
30 (4) This is followed by finding the sum total 

2 m X, 0 k (m) of the probabilities of "1" and the sum total 

^nAi.ic( m ) of the probabilities of "0" in each state, 
calculating the probability that the original data u k 
of the kth item of data is "1" and that the probability 

35 is "0" based upon the magnitudes of the sum totals, 
outputting the larger probability as the kth item of 
decoded data and outputting the likelihood. The 
decoded result is a soft-decision output. 

(d) First MAP decoding method according to prior 

40 art 
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(d-1) Overall structure of MAP decoder 

Fig. 14 is a block diagram of a MAP decoder for 
implementing a first MAP decoding method according to 
the prior art. (For example, see the specification of 
5 Japanese Patent No. 3,451,246.) Encoding route R, 

information length N, original information u, encoded 
data x a , x b and receive data y a , y b are as follows: 

•encoding rate: R = 1/2 

•information length: N 
10 •original information: u = {u 1# u 2 , u 3 ,** # , u N } 

•encoded data: x a = {x al ,x a2 ,x a3 , • • • ,x ak , • • • ,x aN } 

• = t ^bl » ^b2 * ^b3 * * * * * ^bk ***** ^bN ^ 

•receive data: y a = { y ai # Y a2 * Ya3 ***** Yak ***** YaN } 

• Yb = { Ybl * Yb2 * Ya3 ***** Ybk ***** YbN 3" 

15 That is, encoded data x a , x b is generated from the 
original information u of information length N, an 
error is inserted into the encoded data at the time of 
reception, data y a , y b is received and the original 
information u is decoded from the receive data. 
20 Upon receiving (y^y^) at time k, the shift - 

probability calculation unit 1 calculates the following 
probabilities and stores them in a memory 2: 
probability Yo.k that (x^x^) is (0,0) 
probability Yi,k that (x a]c# x bk ) is (0,1) 
25 probability y 2K that (x^x^) is (1,0) 

probability y 3 ,k that (x^x^J is (1,1) 
Using the forward probability a x , k _i(m) that the 
original data u k . x is "1" and the forward probability 
a o.k-i( m ) that the original data u k-1 is "0" in each state 
30 m (= 0 to 3) at the immediately preceding time (k-1), 
as well as the obtained shift probabilities Yo,k* 

Yi,k' Y2,k* Ya,k at time k, a forward-probability 
calculation unit 3 calculates the forward probability 
a x k (m) that the original data u k is "1" and the forward 

35 probability a 0 k (m) that the original data u k is "0" at 

time k and stores these probabilities in memories 4a to 
4d. It should be noted that since processing always 
starts from state m=0, the initial values of forward 

probabilities are ct 0 0 (0) = a x 0 (0) = 1, a 0 0 (m) = a x 0 (m) 

40 =0 (where m=£0). 
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The shift -probability calculation unit 1 and 
forward-probability calculation unit 3 repeat the 
above -described calculations at k = k+1, perform the 
calculations from k=l to k=N to calculate the shift 

5 probabilities Yo.k* Yi.k* Y2,k* Ya,k and forward probabilities 
a x k (m) , a 0 k (m) at each of the times k = 1 to N and 
store these probabilities in memory 2 and memories 4a 
to 4d, respectively. 

Thereafter, a backward-probability calculation 

10 unit 5 calculates the backward probability fJ k (m) (m = 0 
to 3) in each state m (= 0 to 3) at time k using the 
backward probability P k +i(m) and shift probability Ys,* + i 
(s = 0, 1, 2, 3) at time (k+1), where it is assumed 
that the initial value of k is N-l, that the trellis 

15 end state is m=0 and that P N (0) = 1, P N (1) = P„(2) = 

p N (3) =0 hold. 

A first arithmetic unit 6a in a joint -probability 
calculation unit 6 multiplies the forward probability 

<*! k (m) and backward probability p k (m) in each state 
20 m (= 0 to 3) at time k to calculate the probability 
X x k (m) that the kth item of original data u k is "1", 
and a second arithmetic unit 6b in the joint- 
probability calculation unit 6 uses the forward 

probability a 0 k (m) and backward probability P k (m) in 
25 each state m (= 0 to 3) at time k to calculate the 

probability X 0 k (m) that the kth item of original data 
u k is "0". 

A u k and u k likelihood calculation unit 7 adds the 
"1" probabilities X x k (m) (m = 0 to 3) in each of the 
30 states m (= 0 to 3) at time k, adds the "0" 

probabilities ^ 0 ,k( m ) (m = 0 to 3) in each of the states 
m (= 0 to 3), decides the "1", "0" of the kth item of 
data u k based upon the results of addition, namely the 

magnitudes of Ti m k 1 #k (m) and £ m A, 0 k (m) , calculates the 
35 confidence (likelihood) L(u k ) thereof and outputs the 
same . 

The backward-probability calculation unit 5, 
joint -probability calculation unit 6 and u k and u k 
likelihood calculation unit 7 subsequently repeat the 
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foregoing calculations at k = k+1, perform the 
calculations from k=N to k=l to decide the "1" , "0" of 
the original data u k at each of the times k = 1 to N, 
calculate the confidence (likelihood) L(u k ) thereof and 
5 output the same. 

(d-2) Calculation of forward probabilities 

The forward probability a A k (m) that the decoded 
data u k will be i ("0" or "1") in each state (m = 0, 1, 
2, 3) at time k is obtained in accordance with the 
10 following equation based upon 

(1) forward probability a^.^m) in each state at 
time (k-1) and 

(2) transition probability Y±( R k' m ' ' m ) of a 
transition from state m 1 (= 0 to 3) at time (k-1) to 

15 state m (= 0 to 3) at time k: 

a 1 k (m) = E m , E 3 Yi ( R k # m ' , m ) • o. 1 ^_ 1 ( m ' ) / 

Z^.E.E^R^m' ,m) • a^Cm- ) (1) 

Here the transition probability Y±(Rk* ml * m ) is found 
based upon the trellis between state m' (= 0 to 3) at 

20 time (k-1) and the state m (= 0 to 3) at time k as well 
as the receive data y a , y b at time k. Since the 
denominator in the above equation is a portion 
eliminated by division in the calculation of u k and 
likelihood of u k , it need not be calculated. 

25 (d-3) Calculation of backward probability 

In each state (m = 0, 1, 2, 3) at time k, the 

backward probability p k (m) of each state is obtained in 
accordance with the following equation based upon 

(1) backward probability |3 k+1 (m) in each state at 
30 time (k+1) and 

(2) transition probability Y±( R k + i ' m ' ' m ) of a 
transition from state m (= 0 to 3) at time k to state 
m' (= 0 to 3) at time (k+1): 

Mm) = 2 m .5: i Y±(R 1 c.i.ni,m' ) • 0 k+1 (m' )/ 

35 ^S^E.S^Rk,™, 1 *')- ai *( m > ( 2 ) 

Here the transition probability Yi(Rk + l' m * m, ) is found 
based upon the trellis between state m (= 0 to 3) at 
time k and the state m* (= 0 to 3) at time (k+1) as 
well as the receive data y a , y b at time (k+1). Since 



- 9 - 



the denominator in the above equation is a portion 
eliminated by division in the calculation of likelihood, 
it need not be calculated. 

(d-4) Calculation of joint probabilities and 
5 likelihood 

If the forward probabilities a 0 k (m) , a lfk (m) and 

backward probability p k (m) of each state at time k are 
found, these are multiplied to calculate the joint 
probabilities as follows : 

10 k\{m) = a° k (m) -p k (m) 

X^dn) = a 1 k (m)-p k (m) 

The sum total £ m X.° k (m) of the probabilities of "1" and 

the sum total E m X. 1 k (m) of the probabilities of M 0" in 
each of the states are then obtained and the likelihood 
15 is output in accordance with the following equation: 

L(u) = log[S ni ?c 1 k (m)/S ro X 0 k (m)] (3) 
Further, the decoded result u k =l is output if L(u)>0 
holds and the decoded result u k =0 is output if L(u)<0 
holds. That is, the probability that the kth item of 
20 original data u k is "1" and the probability that it is 

"0" are calculated based upon the magnitudes of the sum 

total S m X° k (m) of the probabilities of "1" and of the 

sum total E m X 1 k (m) of the probabilities of "0", and the 
larger probability is output as the kth item of decoded 
25 data. 

(d-5) Problem with first MAP decoding method 
The problem with the first MAP decoding method of 
the prior art shown in Fig. 14 is that the memory used 
is very large. Specifically, the first MAP decoding 

30 method requires a memory of 4 x N for storing 

transition probabilities and a memory of m (number of 
states) x 2 x N for storing forward probabilities, for 

a total memory of(4+mx2) xN. Since actual 
calculation is accompanied by soft-decision signals, 
35 additional memory which is eight times this figure is 
required. 

(e) Second MAP decoding method according to prior 
art 

Accordingly, in order to reduce memory, a method 
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that has been proposed is to perform the calculations 
upon switching the order in which the forward 
probability and backward probability are calculated. 
Fig. 15 is a block diagram of a MAP decoder for 
5 implementing this second MAP decoding method. 

Components identical with those shown in Fig. 14 are 
designated by like reference characters. An 
input/output reverser 8, which suitably reverses the 
order in which receive data is output, has a memory for 

10 storing all receive data and a data output unit for 
outputting the receive data in an order that is the 
reverse of or the same as that in which the data was 
input . With a turbo decoder that adopts the MAP 
decoding method as its decoding method, it is necessary 

15 to interleave the receive data and therefore memory for 
storing all receive data exists. This means that this 
memory for interleaving can also be used as the memory 
of the input/output reverser 8. Hence there is no 
burden associated with memory. 

20 The shift -probability calculation unit 1 uses 

receive data (y^y^) at time k (= N) , calculates the 
following probabilities and stores them in the memory 
2: 

probability Yo,k that (x^.x^) is (0,0) 
25 probability y 1#k that (x^^) is (0,1) 

probability Y 2 ,k that (x^x^) is (1,0) 
probability Ya.k that (x^x^) is (1,1) 
The backward-probability calculation unit 5 
calculates the backward probability P Jc . 1 (m) (m = 0 to 3) 
30 in each state m (= 0 to 3) at time k-1 using the 

backward probability P k (m) and shift probability Ys,k 
(s=0, 1, 2, 3) at time k (= N) and stores the 
backward probabilities in memory 9 . 

The shift -probability calculation unit 1 and 
35 backward-probability calculation unit 5 subsequently 
repeat the above-described calculations at k = k-1, 
perform the calculations from k=N to k=l to calculate 

the shift probabilities Yo,k' Yi.k* Y2.k* Ya,k and backward 
probability p k (m) at each of the times k = 1 to N and 
40 store these probabilities in memories 2, 9. 
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Thereafter, using the forward probability a 1#k .i(ni) 
that the original data u,^ is "1" and the forward 
probability a 0 ^(m) that the original data u k-1 is "0" 
at time (k-1), as well as the obtained shift 

5 probabilities Yo,k' Yi,** Y2.>c Ya,* at time k, the forward- 
probability calculation unit 3 calculates the forward 
probability a x k (m) that u k is "1" and the forward 

probability cx 0 k (m) that u k is "0" in each state m (= 0 
to 3) at time k. It should be noted that the initial 
10 value of k is 1 . 

The joint -probability calculation unit 6 

multiplies the forward probability a x k (m) and backward 

probability |3 k (m) in each state 0 to 3 at time k to 

calculate the probability X. x k (m) that the kth item of 
15 original data u k is "1", and similarly uses the forward 
probability a 0 k (m) and backward probability p k (m) in 
each state 0 to 3 at time k to calculate the 
probability X 0 k (m) that the original data u k is "0". 

The u k and u k likelihood calculation unit 7 adds 
20 the "1" probabilities k (m) (m = 0 to 3) of each of 

the states 0 to 3 at time k, adds the "0" probabilities 
X 0 k (m) (m = 0 to 3) of each of the states 0 to 3 at 
time k, decides the "1" , "0" of the kth item of data u k 
based upon the results of addition, namely the 

25 magnitudes of E m a 1#jc (m) and S m a 0 k (m) , calculates the 

confidence (likelihood) L(u k ) thereof and outputs the 
same . 

The forward-probability calculation unit 3, joint- 
probability calculation unit 6 and u k and u k likelihood 

30 calculation unit 7 subsequently repeat the foregoing 

calculations at k = k+1, perform the calculations from 
k=l to k=N to decide the "1", "0" of u k at each of the 
times k = 1 to N, calculate the confidence (likelihood) 
L(u k ) thereof and output the same. 

35 In accordance with the second MAP decoding method, 

as shown in the time chart of Fig. 16, the processing 
for calculation of shift probability, for calculation 
of backward probability and for storing the results of 
calculation in memory is executed in the first half. 
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and the processing for calculation forward probability, 
for calculation of joint probability and for 
computation of original data and likelihood is executed 
in the second half. In other words, with the second 

5 MAP decoding method, forward probabilities a lfk (m) , 

a 0 k (m) are not stored but the backward probability 

|3 k (m) is stored. As a result, memory required for the 

second MAP decoding method is just 4 x N for storing 

shift probability and 
10 m x N (where m is the number of states) for storing 

backward probability, so that the total amount of 

memory required is (4+m) x N. Thus the amount of 

memory required can be reduced in comparison with the 

first MAP decoding method of Fig. 14. 
15 It should be noted that the memory 2 for storing 

shift probability is not necessarily required. It can 

be so arranged that forward probabilities a lk (m), 

a 0 k (m) can be calculated by calculating the shift 

probabilities y 0#k (s = 0, 1, 2, 3) on each occasion. 
20 (f ) Third MAP decoding method according to prior 

art 

With the second MAP decoding method, the backward 
probability p k (m) need only be stored and therefore the 
amount of memory is comparatively small . However , it 
25 is necessary to calculate all backward probabilities 

P k (m) . If we let N represent the number of data items 
and Tn the time necessary for processing one node, then 
the decoding time required will be 2 x Tn x N. This 
represents a problem. 

30 Fig. 17 is a diagram useful in describing a third 

MAP decoding method according to the prior art . Data 1 
to N is plotted along the horizontal axis and execution 
time along the vertical axis. Further, A indicates 
forward probability or calculation thereof, B indicates 

35 backward probability or calculation thereof, and S 

indicates a soft-decision operation (joint probability, 
u k and u k likelihood calculation). 

According to this method, the results of the 
backward probability calculation B are stored in memory 

40 while the calculation is performed from N-l to N/2. 
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Similarly, the results of the forward probability 
calculation A are stored in memory while the 
calculation is performed from 0 to N/2. If we let Tn 
represent the time necessary for the processing of one 

5 node, a time of Tn x N/2 is required for all processing 
to be completed. Thereafter, with regard to N/2 to 0, 
forward probability A has already been calculated and 
therefore likelihood is calculated while backward 
probability B is calculated. With regard to N/2 to N-l, 

10 backward probability B has been calculated and 

therefore likelihood is calculated while forward 
probability A is calculated. Calculations are 
performed by executing these processing operations 
concurrently. As a result, processing is completed in 

15 the next period of time of 

Tn x N/2. That is, according to the third MAP decoding 

method, decoding can be performed in time Tn x N and 
decoding time can be shorted in comparison with the 
second MAP decoding method. However, since forward 
20 probability must be stored, a greater amount of memory 
is used in comparison with the second MAP decoding 
method. 

(g) Fourth MAP decoding method according to prior 
art 

2 5 The second and third methods cannot solve both the 

problem relating to decoding time and the problem 
relating to amount of memory used. Accordingly, a 
metric calculation algorithm for shortening decoding 
time and reducing amount of memory used has been 

30 proposed. The best-known approach is referred to as 
the "sliding window method" (referred to as the "SW 
method" below), the actual method proposed by Viterbi. 
(For example, see IEEE JOURNAL ON SELECTED AREAS IN 
COMMUNICATIONS, VOL. 16, NO. 2, FEBRUARY 1998, "An 

35 Intuitive Justification and a Simplified Implementation 
of the MAP Decoder for Convolutional Codes", Andrew J. 
Viterbi. ) 

Fig. 18 is a diagram useful in describing the 
operation sequence of a fourth MAP decoding method 
40 using the SW method according to the prior art. Here a 
B operation signifies backward probability calculation 
(inclusive of shift probability calculation), an A 
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operation signifies forward probability calculation 
(inclusive of shift probability calculation), and an S 
operation signifies soft-decision calculation (joint 
probability calculation / likelihood calculation). 
5 In the SW method, k = 1 to N is divided equally 

into intervals L and MAP decoding is executed as set 
forth below. 

First, (1) the B operation is performed from k = 
2L to k = 1 . In the B operation, the backward 

10 probability p k (m) is not calculated from k = N; 

calculation starts from the intermediate position k = 
2L. As a consequence, the backward probability P k (m) 
found over k = 2L to k = L+l (a training period) in the 
first half cannot be trusted and is discarded. The 

15 backward probability P k (m) found over k = L to k = 1 in 
the second half can be trusted to some extent and 
therefore this is stored in memory. (2) Next, the A 
operation is performed at k = 1, the S operation is 

performed using the results a x #1 (m) , a 0 #1 (m) of the A 

20 operation at k = 1 as well as p x (m) that has been 
stored in memory, and the decoded result u x and 
likelihood L (u x ) are calculated based upon the joint 
probabilities. Thereafter, and in similar fashion, the 
A operation is performed from k = 2 to k = L and the S 

25 operation is performed based upon the results of the A 
operation and the results of the B operation in memory. 
This ends the calculation of the decoded result u k and 
likelihood L (u k ) from k = 1 to k = L. 

Next, (3) the B operation is performed from k = 3L 

30 to k = to L+l. In the B operation, the backward 

probability P k (m) is not calculated from k = N; 
calculation starts from the intermediate position k = 
3L. As a consequence, the backward probability p k (m) 
found over k = 3L to k = 2L+1 (the training period) in 
35 the first half cannot be trusted and is discarded. The 

backward probability p k (m) found over k = 2L to k = L+l 
in the second half can be trusted to some extent and 
therefore this is stored in memory. (4) Next, the A 
operation is performed at k = L+l, the S operation is 

40 performed using the results a liL+1 (m) , a 0 L+1 (m) of the A 
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operation at k = L+l as well as (3 L+1 (m) that has been 
stored in memory, and the decoded result u L+1 and 
likelihood L (u L+1 ) are calculated based upon the joint 
probabilities. Thereafter, and in similar fashion, the 
5 A operation is performed from k = L+2 to k = 2L and the 
S operation is performed based upon the results of the 
A operation and the results of the B operation in 
memory. This ends the calculation of the decoded 
result u k and likelihood L (u k ) from k = L+l to k = 2L. 

10 Thereafter, and in similar fashion, the calculation of 
the decoded result u k and likelihood L (u k ) up to k = N 
is perf ormed . 

It should be noted that in the third MAP decoding 
method set forth above, the A operation over L is 

15 performed after the B operation over 2L. In terms of a 
time chart, therefore, this is as indicated in Fig. 19A. 
Here, however, the A operation is intermittent and 
calculation takes time as a result. Accordingly, by so 
arranging it that the A operation is performed 

20 continuously by executing the first and second halves 
of the B operation simultaneously using two means for 
calculating backward probability, as shown in Fig. 19B, 
the speed of computation can be raised. Fig. 20 is a 
time chart having an expression format the same as that 

25 of the present invention described later and 

illustrates content identical with that of Fig. 19B. 
The horizontal and vertical axes indicate input data 
and processing time, respectively. 

In accordance with MAP decoding in the SW method, 

30 one forward probability calculation unit, two backward 
probability calculation units and one soft-decision 
calculation unit are provided and these are operated in 
parallel, whereby one block's worth of a soft-decision 
processing loop can be completed in a length of time of 

35 (N+2L) x Tn. Further, the amount of memory necessary 
is merely that equivalent to 2L nodes of backward 
probability. 

With the SW method, backward probability P k (m) is 
not calculated starting from k = N. Since the same 
40 initial value is set and calculation starts in mid- 
course, the backward probability p k (m) is not accurate. 
In order to obtain a good characteristic in the SW 
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method, therefore, it is necessary to provide a 
satisfactory training period T L . The length of this 
training portion ordinarily is required to be four to 
five times the constraint length. 
5 If the encoding rate is raised by puncturing, 

punctured bits in the training portion can no longer be 
used in calculation of metrics. Consequently, even a 
training length that is four to five times the 
constraint length will no longer be satisfactory and a 

10 degraded characteristic will result* In order to 
maintain a good characteristic, it is necessary to 
increase the length of the training portion further. A 
problem which arises is an increase in amount of 
computation needed for decoding and an increase in 

15 amount of memory used. 

SUMMARY OF THE INVENTION 
Accordingly, an object of the present invention is 
to enable a reduction is memory used and, moreover, to 
substantially lengthen the training portion so that 

20 backward probability |3 k (m) can be calculated accurately 
and the precision of MAP decoding improved. 

According to the present invention, the foregoing 
object is attained by providing a maximum a posteriori 
probability decoding method (MAP decoding method) and 

25 apparatus for repeatedly executing decoding processing 
using the sliding window (SW) method. The sliding 
window (SW) method includes dividing encoded data of 
length N into blocks each of prescribed length L, 
calculating backward probability from a data position 

30 (initial positions) backward of a block of interest 

when the backward probability of the block of interest 
is calculated, obtaining and storing the backward 
probability of the block of interest, then calculating 
forward probability, executing decoding processing of 

35 each data item of the block of interest using the 

forward probability and the stored backward probability 
and subsequently executing decoding processing of each 
block in regular order. 

In maximum a posteriori probability decoding for 

40 repeatedly executing decoding processing using the 

sliding window (SW) method, the fundamental principle 
of the present invention is as follows: Forward 



-Im- 



probabilities and/or backward probabilities at initial 
positions , which probabilities have been calculated 
during a current cycle of MAP decoding processing, are 
stored as initial values of forward probabilities 
5 and/or backward probabilities in MAP decoding executed 
in the next cycle. Then, in the next cycle of MAP 
decoding processing, calculation of forward 
probabilities and/or backward probabilities is started 
from the stored initial values . 

10 In first maximum a posteriori probability decoding, 

backward probability at a starting point (initial 
position) of backward probability calculation of 
another block, which backward probability is obtained 
in current decoding processing of each block, is stored 

15 as an initial value of backward probability of the 

other block in decoding processing to be executed next, 
and calculation of backward probability of each block 
is started from the stored initial value in decoding 
processing the next time. 

20 In second maximum a posteriori probability 

decoding, backward probability at a starting point of 
another block, which backward probability is obtained 
in current decoding processing of each block, is stored 
as an initial value of backward probability of the 

25 other block in decoding processing to be executed next, 
and calculation of backward probability is started, 
without training, from the starting point of this block 
using the stored initial value in decoding processing 
of each block executed next . 

30 In third maximum a posteriori probability decoding, 

( 1 ) encoded data of length N is divided into blocks 
each of prescribed length L and processing for 
calculating backward probabilities from a data position 
(backward-probability initial position) backward of 

35 each block, obtaining the backward probabilities of 
this block and storing. the backward probabilities is 
executed in parallel simultaneously for all blocks; (2) 
when forward probability of each block is calculated, 
processing for calculating forward probability from a 

40 data position (forward-probability initial position) 
ahead of this block and obtaining the forward 
probabilities of this block is executed in parallel 
simultaneously for all blocks; (3) decoding processing 
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of the data in each block is executed in parallel 
simultaneously using the forward probabilities of each 
block and the stored backward probabilities of each 
block; (4) a backward probability at the backward - 
5 probability initial position of another block, which 
backward probability is obtained in current decoding 
processing of each block, is stored as an initial value 
of backward probability of the other block in decoding 
processing to be executed next; (5) a forward 

10 probability at the f orward-probability initial position 
of another block, which forward probability is obtained 
in current decoding processing of each block, is stored 
as an initial value of forward probability of the other 
block in decoding processing to be executed next; and 

15 (6) calculation of forward probability and backward 

probability of each block is started in parallel using 
the stored initial values in decoding processing 
executed next . 

In accordance with the present invention, a 

20 training period can be substantially secured and 

deterioration of the characteristic at a high encoding 
rate can be prevented even if the length of the 
training portion is short, e.g., even if the length of 
the training portion is made less than four to five 

25 times the constraint length or even if there is no 

training portion. Further, the amount of calculation 
performed by a turbo decoder and the amount of memory 
used can also be reduced. 

First maximum a posteriori probability decoding 

30 according to the present invention is such that from 
the second execution of decoding processing onward, 
backward probabilities for which training has been 
completed are set as initial values. Though this 
results in slightly more memory being used in 

35 comparison with a case where the initial values are 
made zero , substantial training length is extended, 
backward probability can be calculated with excellent 
precision and deterioration of characteristics can be 
prevented. 

40 Second maximum a posteriori probability decoding 

according to the present invention is such that from 
the second execution of decoding processing onward, 
backward probability for which training has been 
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completed is set as the initial value. Though this 
results in slightly more memory being used in 
comparison with a case where the initial value is made 
zero, substantial training length is extended, backward 
5 probability can be calculated with excellent precision 
and deterioration of characteristics can be prevented. 
Further, the amount of calculation in the training 
portion can be reduced and time necessary for decoding 
processing can be shortened. 

10 In accordance with third maximum a posteriori 

probability decoding according to the present invention, 
forward and backward probabilities are both calculated 
using training data in metric calculation of each sub- 
block, whereby all sub-blocks can be processed in 

15 parallel. This makes high-speed MAP decoding possible. 
Further, in the second execution of decoding processing 
onward, forward and backward probabilities calculated 
and stored one execution earlier are used as initial 
values in calculations of forward and backward 

20 probabilities, respectively, and therefore highly 
precise decoding processing can be executed.. 

Other features and advantages of the present 
invention will be apparent from the following 
description taken in conjunction with the accompanying 

25 drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 
Fig. 1 is a block diagram illustrating the 
configuration of a communication system that includes a 
turbo encoder and a turbo decoder; 
30 Fig. 2 is a block diagram of the turbo decoder; 

Fig. 3 is a time chart of a maximum a posteriori 
probability decoding method according to a first 
embodiment of the present invention; 

Fig. 4 is a block diagram of a maximum a 
35 posteriori probability decoding apparatus according to 
the first embodiment; 

Fig. 5 is a time chart of a maximum a posteriori 
probability decoding method according to a second 
embodiment of the present invention; 
40 Fig. 6 is a time chart of a maximum a posteriori 

probability decoding method according to a third 
embodiment of the present invention; 

Fig. 7 is a block diagram of a maximum a 



- 20 - 



posteriori probability decoding apparatus according to 
the third embodiment; 

Fig. 8 is a diagram useful in describing the 
sequence of turbo decoding to which the present 
5 invention can be applied; 

Fig. 9 shows an example of an encoder according to 
the prior art; 

Fig. 10 is a diagram useful in describing the 
relationship between inputs and outputs of a 
10 convolutional encoder as well as the states of a shift 
register according to the prior art; 

Fig. 11 is a diagram useful in describing the 
states of the convolutional encoder; 

Fig. 12 is a diagram showing the relationship 
15 between the states and input /output of a convolutional 
encoder according to the prior art; 

Fig. 13 is a trellis diagram in which 
convolutional codes of the convolutional encoder are 
expressed in the form of a lattice according to the 
20 prior art; 

Fig. 14 is a block diagram of a MAP decoder for 
implementing a first MAP decoding method according to 
the prior art; 

Fig. 15 is a block diagram of a MAP decoder for 
25 implementing a second MAP decoding method according to 
the prior art; 

Fig. 16 is a time chart associated with Fig. 15; 

Fig. 17 is a diagram useful in describing a third 
MAP decoding method according to the prior art ; 
30 Fig. 18 is a diagram useful in describing a 

calculation sequence for describing a fourth MAP 
decoding method using the SW method according to the 
prior art; 

Figs. 19A and 19B are time charts of the fourth 
35 MAP decoding method according to the prior art; and 
Fig. 20 is a time chart of the prior-art fourth 
MAP decoding method having an expression format 
identical with that of the present invention. 

DESCRIPTION OF THE PREFERRED EMBODIMENTS 
40 (A) Turbo codes 

The MAP decoding method manifests its 
effectiveness in turbo codes. Fig. 1 is a block diagram 
of a communication system that includes a turbo encoder 
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11 and a turbo decoder 12. The turbo encoder 11 is 
provided on the data transmitting side and the turbo 
decoder 12 is provided on the data receiving side. 
Numeral 13 denotes a data communication path. Further, 
5 reference character u represents transmit informational 
data of length N; xa, xb, xc represent encoded data 
obtained by encoding the informational data u by the 
turbo encoder 11; ya, yb, yc denote receive signals 
that have been influenced by noise and fading as a 
10 result of propagation of the encoded data xa, xb, xc 
through the communication path 13; and u' represents 
results of decoding obtained by decoding the receive 
data ya, yb, yc by the turbo decoder 12. These items 
of data are as expressed below. 



15 


Original data: u = 


{ul, u2. 


u3 , • 


" ' ' U N> 






Encoded data: xa = 


{ x ai , x a2 , 


X a3 ' 


' X ak' 


' X aN ^ 




: xb = 


t X bl ' X b2 * 


X b3 ' 


* X bk' 


* X bN^ 




: xc = 


{ X cl * ^c2 * 


X c3 ' 


* X ck' 


# x cN )- 




Receive data: ya = 


t Yal * Ya2 * 


Ya3 ' 


* Yak ' 


* YaN y 


20 


: yb = 


{ Ybl ' Yb2 ' 


Yb3 ' 


* Ybk' 


' YbN^ 




: yc = 


{ Ycl ' Yc2 ' 


Yc3 ' 


' Yck' 


* YcN^ 



The turbo encoder 11 encodes the informational data u 
of information length N and outputs the encoded data xa, 
xb, xc. The encoded data xa is the informational data 



25 u per se, the encoded data xb is data obtained by the 
convolutional encoding of the informational data u by 
an encoder ENC1 , and the encoded data xc is data 

obtained by the interleaving ( 7t ) and convolutional 
encoding of the informational data u by an encoder ENC2 . 
30 In other words, a turbo code is obtained by combining 
two convolutional codes. It should be noted that an 
interleaved output xa' differs from the encoded 
data xa only in terms of its sequence and therefore is 
not output. 

35 Fig. 2 is a block diagram of the turbo decoder. 

Turbo decoding is performed by a first element decoder 
DEC1 using ya and yb first among the receive signals ya, 
yb, yc. The element decoder DEC1 is a soft -output 
element decoder and outputs the likelihood of decoded 

40 results. Next, similar decoding is performed by a 

second element decoder DEC2 using the likelihood, which 
is output from the first element decoder DEC1, and yc. 
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That is, the second element decoder DEC 2 also is a 
soft -output element decoder and outputs the likelihood 
of decoded results. Here yc is a receive signal 
corresponding to xc, which was obtained by interleaving 
5 and then encoding the original data u. Accordingly, 
the likelihood that is output from the first element 

decoder DEC1 is interleaved ( 7t ) before it enters the 
second element decoder DEC2 . The likelihood output 
from the second element decoder DEC2 is deinterleaved 

10 (Tt" 1 ) and then is fed back as the input to the first 
element decoder DEC1. Further, u' is decoded data 
(results of decoding) obtained by rendering a "0" , "1" 
decision regarding the interleaved results from the 
second element decoder DEC2 . Error rate is reduced by 

15 repeating the above-described decoding operation a 
prescribed number of times . 

MAP element decoders can be used as the first and 
second element decoders DEC1, DEC2 in such a turbo 
element decoder. 

20 (B) First Embodiment 

Fig. 3 is a time chart of a maximum a posteriori 
probability decoding method according to a first 
embodiment applicable to a MAP element decoder. 

According to the first embodiment, processing 

25 identical with that of the conventional SW method is 

performed in the first execution of decoding processing 
(the upper half of Fig. 3). Specifically, backward 
probabilities in respective ones of blocks , namely a 
block BL1 from L to 0, a block BL2 from 2L to L, a 

30 block BL3 from 3L to 2L, a block BL4 from 4L to 3L, a 
block BL5 from 5L to 4L, •**, are calculated in order 
from data positions (initial positions) backward of 
each block using prescribed values an initial values, 
whereby backward probabilities at the starting points 

35 of each of the blocks are obtained. (This represents 
backward-probability training.) For example, backward 
probabilities are trained (calculated) in order from 
data positions 2L, 3L, 4L, 5L, 6L, ••• backward of each 
of the blocks to obtain backward probabilities at 

40 starting points L, 2L, 3L, 4L, 5L, ••• of each of the 

blocks. After such training is performed, the backward 
probabilities of each of the blocks BL1, BL2, BL3, ••• 
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are calculated from the backward probabilities of the 
starting points of the blocks, and the calculated 
backward probabilities are stored. After the 
calculation of all backward probabilities, forward 
5 probabilities are calculated and processing for 
decoding each data item in a block of interest is 
executed using the forward probability and the stored 
backward probability. It should be noted that 
processing for decoding each of the blocks is executed 
10 in the following order, as should be obvious from the 
time chart: first block, second block, third block, 
• • • and so on. 

In the first execution of decoding processing (the 
upper half of Fig. 3) based upon the SW method, values 

15 of backward probabilities p o , 0 L , 0 2L , p 3L , p 4L , ••• at 

final data positions 0, L, 2L, 3L, 4L , ••• of each of 
the blocks are stored as initial values of backward 

probabilities for the next time. (In actuality, p o and 

p L are not used. ) 

20 In the second execution of decoding processing 

(the lower half of Fig. 3), backward probabilities in 
respective ones of blocks, namely block BL1 from L to 0, 
block BL2 from 2L to L, block BL3 from 3L to 2L, block 
BL4 from 4L to 3L, block BL5 from 5L to 4L, are 

2 5 calculated, after training, using the stored backward 

probabilities p 2L , p3 L * p4L* as initial values. It 

should be noted that in the second execution of 
decoding processing, values of backward probabilities 

Po'* Pi.'. P 3 L f . P4l'. at final data positions 0, 

30 L, 2L, 3L, 4L, ••• in each of the blocks are stored as 
initial values of backward probabilities for the next 
time . 

As set forth above, values of backward 
probabilities p 0 , 0 L , p 2L , p 3L , p 4L , ••• at final data 
35 positions 0, L, 2L, 3L, 4L, *•• of each of the blocks 
are stored as initial values of backward probabilities 
for the next time. However, values of backward 

probabilities p 0 ", p L " , p 2L '\ p 3L ", p 4L " , • • • at 
intermediate positions can also be stored as initial 
40 values of backward probabilities for the next time. 
Fig. 4 is a block diagram of a maximum a 
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posteriori probability decoding apparatus according to 
the first embodiment. Processing and calculations 
performed by the components of this apparatus are 
controlled by timing signals from a timing control unit 
5 20. 

An input data processor 21 extracts the necessary 
part of receive data that has been stored in a memory 
(not shown) and inputs this data to a shift -probability 
calculation unit 22. The latter calculates the shift 

10 probability of the input data and inputs the shift 

probability to first and second backward- probability 
calculation units 23, 24, respectively, and to a 
forward-probability calculation unit 25. 

The first backward-probability calculation unit 23 

15 starts the training calculation of backward 

probabilities in L to 0, 3L to 2L, 5L to 4L, of the 

odd-numbered blocks BL1, BL3, BL5, ••• in Fig. 3 from 
the initial positions (2L, 4L, 6L, ■••)# stores the 
backward probabilities of these blocks in a P storage 

20 unit 26, calculates values of backward probabilities 
(Pc P21.' P«,' *••) at final data positions (0, 2L, 4L, 
• • • ) of each of the blocks and stores these in a P 
initial-value storage unit 27 as initial values of 
backward probabilities for the next time. It should be 

25 noted that the final backward probability p jL of the 

(j+2)th block is used as the initial value of backward 
probability of the jth block in decoding processing the 
next time, where 3 is an odd number. 

The second backward-probability calculation unit 

30 24 starts the training calculation of backward 

probabilities in 2L to L, 4L to 3L, 6L to 5L, ••• of 
the even-numbered blocks BL2, BL4, BL6, ••• in Fig. 3 
from the initial positions (3L, 5L, 7L, •••)# stores 
the backward probabilities of these blocks in a p 

35 storage unit 28, calculates values of backward 

probabilities (p L , P 3L , P 5L , •••) at final data positions 
(L, 3L, 5L, •••) of each of the blocks and stores these 
in the p initial-value storage unit 27 as initial 
values of backward probabilities for the next time. It 

40 should be noted that the final backward probability P JL 
of the (j+2)th block is used as the initial value of 
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backward probability of the jth block in decoding 
processing the next time, where j is an odd number. 

The forward-probability calculation unit 25 
calculates the forward probabilities of each of the 
5 blocks continuously. A selector 29 appropriately 

selects and outputs backward probabilities that have 

been stored in the p storage units 26, 28, a joint- 
probability calculation unit 30 calculates the joint 
probability, and a u k and u k likelihood calculation 
10 unit 31 decides the "1", "0" of data u k , calculates the 
confidence (likelihood) L(u k ) thereof and outputs the 
same. 

If a first execution of decoding processing of all 
1 to N data items has been completed, then the P 

15 initial-value setting unit 32 reads the initial values 
of p out of the P initial-value storage unit 27 and 
sets these in the backward-probability calculation 
units 23, 24 when the first and second backward- 
probability calculation units 23, 24 calculate the 

20 backward probabilities of each of the blocks in the 
next execution of decoding processing. 

Each of the above units executes decoding 
processing in order block by block at timings (Figs. 19 
and 20) similar to those of the well-known SW method 

25 based upon timing signals from the timing control unit 
20 in accordance with the time chart of Fig. 3. 

Thus, the first embodiment is such that from the 
second execution of decoding processing onward, 

backward probabilities p o , p L , p 2L , p 3L , p 4L , for 

30 which training has been completed are set as initial 
values. Though this results in slightly more memory 
being used in comparison with a case where fixed values 
are adopted as the initial values, substantial training 
length is extended threefold, backward probabilities 
35 can be calculated with excellent precision and 

deterioration of characteristics can be prevented. 
(C) Second Embodiment 

Fig. 5 is a time chart of a maximum a posteriori 
probability decoding method according to a second 
40 embodiment . 

According to the second embodiment, processing 
identical with that of the conventional SW method is 
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performed in the first execution of decoding processing 
(the upper half of Fig. 5). Specifically, backward 
probabilities in respective ones of blocks, namely 
block BL1 from L to 0, block BL2 from 2L to L, block 
5 BL3 from 3L to 2L, block BL4 from 4L to 3L, block BL5 
from 5L to 4L, are calculated in order from data 

positions (initial positions) backward of each block 
using fixed values an initial values, whereby backward 
probabilities at the starting points of each of the 

10 blocks are obtained. (This represents backward- 
probability training.) For example, backward 
probabilities are trained (calculated) in order from 
data positions 2L, 3L, 4L, 5L, 6L, ••• backward of each 
of the blocks to obtain backward probabilities at 

15 starting points L , 2L, 3L, 4L, 5L, ••• of each of the 

blocks. After such training is performed, the backward 
probabilities of each of the blocks BL1, BL2, BL3 , ■•• 
are calculated from the backward probabilities of the 
starting points of the blocks and the calculated 

20 backward probabilities are stored. After the 

calculation of all backward probabilities, forward 
probabilities are calculated and processing for 
decoding each data item in a block of interest is 
executed using forward probability and the stored 

25 backward probability. It should be noted that the 

decoding processing of each of the blocks is executed 
in order as follows, as should be obvious from the time 
chart: first block, second block, third block, 
and so on. 

30 In the first execution of decoding processing (the 

upper half of Fig. 5) based upon the SW method, values 

of backward probabilities (5 0 , p L , P 2L , P 3L# P 4L , • • • at 
final data positions 0, L, 2L, 3L, 4L, of each of 

the blocks are stored as initial values of backward 

35 probabilities for the next time. (In actuality, p 0 is 
not used. ) 

In the second execution of decoding processing 
(the lower half of Fig. 5), the backward probabilities 
in respective ones of the blocks, namely block BL1 from 
40 L to 0, block BL2 from 2L to L, block BL3 from 3L to 2L, 
block BL4 from 4L to 3L, block BL5 from 5L to 4L, 
are calculated directly, without carrying out training, 
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using the stored backward probabilities P L , P 2L , p 3L , 

p 4L * • • as initial values. Furthermore, in the second 
execution of decoding processing, values of backward 

probabilities p o ', p L ' , p 2L f , P 3L ' , p 4L ', ••• at final 
5 data positions 0, L, 2L, 3L, 4L, ••• in each of the 
blocks are stored as initial values of backward 
probabilities for the next time. 

As set forth above, values of backward 

probabilities p 0 , P L , P 2L , P 3L , P 4L , • • • at final data 
10 positions 0, L, 2L, 3L, 4L, ■•• of each of the blocks 
are stored as initial values of backward probabilities 
for the next time. However, values of backward 

probabilities p 0 ", p L " , p 2L " , p 3L " . P 4I /\ • • • at 
intermediate positions can also be stored as initial 

15 values of backward probabilities for the next time. 

A maximum a posteriori probability decoding 
apparatus according to the second embodiment has a 
structure identical with that of the first embodiment 
in Fig. 4. The apparatus executes decoding processing 

20 in order block by block at timings (Figs. 19 and 20) 

similar to those of the well-known SW method based upon 
timing signals from the timing control unit 20 in 
accordance with the time chart of Fig. 5. 

Thus , the second embodiment is such that from the 

25 second execution of decoding processing onward, 

backward probabilities for which training has been 
completed are set as initial values. Though this 
results in slightly more memory being used in 
comparison with a case where fixed values are adopted 

30 as the initial values, substantial training length is 

extended, backward probabilities can be calculated with 
excellent precision and deterioration of 
characteristics can be prevented. In addition, the 
amount of calculation in the training portion can be 

35 reduced and time necessary for decoding processing can 
be shortened. Further, though the amount of 
calculation in the training portion can be reduced, the 
training length is twice that of the conventional SW 
method, backward probabilities can be calculated with 

40 excellent precision and deterioration of 
characteristics can be prevented. 
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(D) Third Embodiment 

Fig. 6 is a time chart of a maximum a posteriori 
probability decoding method according to a third 
embodiment . 

5 The third embodiment is premised on the fact that 

all input receive data of one encoded block has been 
read in and stored in memory. Further, it is assumed 
that backward- probability calculation means, forward 
probability-calculation means and soft -decision 

10 calculation means have been provided for each of the 

blocks of block BL1 from L to 0, block BL2 from 2L to L, 
block BL3 from 3L to 2L, block BL4 from 4L to 3L, block 
BL5 from 5L to 4L, The third embodiment is 

characterized in the following four points: (1) SW- 

15 type decoding processing is executed in parallel block 
by block; (2) forward-probability calculation means for 
each block executes a training operation and calculates 
forward probability; (3) forward probabilities and 
backward probabilities obtained in the course of the 

20 preceding calculations are stored as initial values for 
calculations the next time; and (4) calculations are 
performed the next time using the stored backward 
probabilities and forward probabilities as initial 
values. It should be noted that the fact that decoding 

25 processing is executed in parallel block by block in 
(1) and (2) also is new. 

In the third embodiment, the decoding processing 
of each of the blocks is executed in parallel (the 
upper half of Fig. 6). More specifically, backward- 

30 probability calculation means for each block calculates 
backward probabilities in each of the blocks, namely 
block BL1 from L to 0 , block BL2 from 2L to L, block 
BL3 from 3L to 2L, block BL4 from 4L to 3L, block BL5 
from 5L to 4L, • • • , in order in parallel fashion from 

35 data positions (initial positions) backward of each 
block using fixed values an initial values, thereby 
obtaining backward probabilities at the starting points 
of each of the blocks. (This represents backward- 
probability training.) For example, backward 

40 probabilities are trained (calculated) in order in 

parallel fashion from data positions 2L, 3L, 4L, 5L, 6L, 
• • • backward of each of the blocks to obtain backward 
probabilities at starting points L, 2L, 3L, 4L, 5L, ••• 
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of each of the blocks. Thereafter, the backward 
probabilities of each of the blocks are calculated in 
parallel using the backward probabilities at the 
starting points of these blocks, and the calculated 
5 backward probabilities are stored. Furthermore, the 

values of backward probabilities (3 0 , p L , p 2L , f$ 3L , (3 4L , 
••• at final data positions 0, L, 2L, 3L, 4L, ••• of 
each of the blocks are stored as initial values of 
backward probabilities for the next time. (In 

10 actuality, p 0 , p L are not used.) That is, the final 

backward probability p JL of the (j+2)th block is stored 
as the initial value of backward probability of the jth 
block in decoding processing the next time. 

In parallel with the above, forward-probability 

15 calculation means for each block calculates forward 

probabilities in each of the blocks, namely block BL1 
from L to 0, block BL2 from 2L to L, block BL3 from 3L 
to 2L, block BL4 from 4L to 3L, block BL5 from 5L to 4L, 
• • • , in order in parallel fashion from data positions 

20 (initial positions) ahead of each block using fixed 
values an initial values, thereby obtaining forward 
probabilities at the starting points of each of the 
blocks. (This represents forward-probability training. 
However, training is not performed in block BL1 . ) For 

25 example, forward probabilities are trained (calculated) 
in order in parallel fashion from data positions 0, L, 
2L, 3L, 4L, ••• ahead of each of the blocks BL2 , BL3, 
BL4 , BL5, forward probabilities of each of the 

blocks are calculated in parallel and decoding 

30 processing of the data of each of the blocks is 

executed in parallel using these forward probabilities 
and the stored backward probabilities. 

Further, the values of forward probabilities c^, 

a 2L* a 3L* a 4L* a 5L* * * # at final data positions L, 2L, 3L, 
35 4L, 5L ••• in each of the blocks, namely block BL1 from 
0 to L, block BL2 from L to 2L, block BL3 from 2L to 3L , 
block BL4 from 3L to 4L, block BL5 from 4L to 5L, 
are stored as initial values of forward probabilities 
for the next time. That is, the final forward 

40 probability tx JL of the jth block is stored as the 
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initial value of forward probability of the (j+2)th 
block in decoding processing the next time. 

In the second execution of decoding processing 
(the lower half of Fig. 6), the arithmetic unit of each 
5 block performs training using the stored backward 

probabilities P 2L , P 3L , p 4L * • • as initial values and 
thereafter calculates the backward probabilities of 
block BL1 from L to 0, block BL2 from 2L to L, block 
BL3 from 3L to 2L, block BL4 from 4L to 3L # 
10 Similarly, the arithmetic unit performs training using 

the stored forward probabilities c^, a 2L , a 3L , a 4L # • • as 
initial values and thereafter calculates the forward 
probabilities of block BL1 from 0 to L, block BL2 from 
L to 2L, block BL3 from 2L to 3L # block BL4 from 3L to 
15 4L, • • • and performs a soft-decision operation. 

Furthermore, in the second execution of decoding 

processing, values of backward probabilities p 0 '# Pl' » 

P 3 l', P4L^ of final data 0, L, 2L, 3L, 4L, 

in each of the blocks are stored as initial values of 
20 backward probabilities for the next time. Further, 

forward probabilities c^', a 2L ' , a 3L ' , a 4L ' , ••• of final 
data L, 2L, 3L, 4L, ••• in each of the blocks are 
stored as initial values of forward probabilities for 
the next time. 

25 Fig. 7 is a block diagram of a maximum a 

posteriori probability decoding apparatus according to 
the third embodiment. Here an input data processor 41 
extracts the necessary part of N items of encoded data 
that have been stored in memory (not shown) and inputs 

30 the extracted data to decoding processors 42 1# 42 2 , 42 3 , 
42 4 , ••• provided for respective ones of jth blocks (j 
= 1, 2, 3 • • • ) . 

Each of the decoding processors 42 1# 42 2 , 42 3 , 42 4 , 
• • • is identically constructed and has a shift - 

35 probability calculation unit 51, a backward-probability 
calculation unit 52, a forward-probability calculation 

unit 53, a P storage unit 54, a joint-probability 
calculation unit 55 and a u k and u k likelihood 
calculation unit 56. 
40 The forward-probability calculation unit 53 of the 

jth decoding processor 42., of the jth block stores 
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forward probability a JL conforming to final data jL of 
the jth block in a storage unit (not shown) and inputs 
it to the forward-probability calculation unit 53 of 
the (j+2)th decoding processor 42 j+2 as the initial 
5 value of the next forward probability calculation. 

Further, the backward-probability calculation unit 
52 of the (j + 2)th decoding processor 42 J+2 of the 

(j + 2)th block stores backward probability P (J+ i )L 
conforming to final data (j+1) of the (j+2)th block in 

10 a storage unit (not shown) and inputs it to the 

backward-probability calculation unit 52 of the jth 
decoding processor 42 d as the initial value of the next 
forward probability calculation. 

The maximum a posteriori probability decoding 

15 apparatus according to the third embodiment executes 
decoding processing of each of the blocks in parallel 
in accordance with the time chart of Fig. 6, stores 
forward probabilities and backward probabilities 
obtained in the course of calculation as initial values 

20 for calculations the next time, and uses the stored 
backward probabilities and forward probabilities as 
initial values in calculations the next time. 

Thus, in the third embodiment, forward and 
backward probabilities are both calculated using 

2 5 training data in metric calculation of each sub-block, 
whereby all sub-blocks can be processed in parallel. 
This makes high-speed MAP decoding possible. Further, 
in the second execution of decoding processing onward, 
forward and backward probabilities calculated and 

30 stored one execution earlier are used as initial values 
in calculations of forward and backward probabilities , 
respectively, and therefore highly precise decoding 
processing can be executed. 
(E) Fourth Embodiment 

35 Fig. 8 is a diagram useful in describing the 

sequence of turbo decoding to which the present 
invention can be applied. As is obvious from Fig. 8, 
turbo decoding is repeated a plurality of times 
treating a first half of decoding, which uses ya, yb, 

40 and a second half of decoding, which uses ya, yc, as 
one set. 
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An external -information likelihood calculation 
unit EPC1 outputs external- information likelihood 
Le(ul) using a posteriori probability L(u) output in 
the first half of a first cycle of MAP decoding and the 
5 input signal ya to the MAP decoder. This external- 
information likelihood Le(u) is interleaved and output 
as a priori likelihood L(u2') used in the next half of 
MAP decoding . 

In MAP decoding from the second cycle onward, 

10 turbo decoding is such that [signal ya + a priori 
likelihood L(u3')l is used as the input signal ya. 
Accordingly, in the second half of the first cycle of 
MAP decoding, an external -information likelihood 
calculation unit EPC2 outputs external-information 

15 likelihood Le(u2), which is used in the next MAP 
decoding, using the a posteriori likelihood L(u2) 
output from the element decoder DEC2 and the decoder 
input signal [= signal ya + a priori likelihood L(u2')]. 
This external- information likelihood Le(u2) is 

2 0 deinterleaved and output as a priori likelihood (u3') 
used in the next cycle of MAP decoding. 

Thereafter, and in similar fashion, the external- 
information likelihood calculation unit EPC1 outputs 
external-information likelihood Le(u3) in the first 

25 half of the second cycle, and the external -information 
likelihood calculation unit EPC2 outputs external- 
information likelihood Le(u4) in the second half of the 
second cycle. In other words, the following equation 
is established using the log value of each value: 

30 L(u) = Lya + L(u' ) + Le(u) (4) 

The external-information likelihood calculation unit 
EPC1 therefore is capable of obtaining the external- 
information likelihood Le(u) in accordance with the 
following equation: 

35 Le(u) - L(u) - Lya - L(u') (5) 

where L(u' ) = 0 holds the first time. 

To summarize , therefore , in the first half of 

decoding processing the first time, decoding is 
performed using receive signals Lcya, Lcyb and the 

40 likelihood L(u x ) obtained is output. Next, the a 

priori probability Le(uJ is obtained in accordance 
with Equation (5) [where Mu^) = 0 holds], this is 
interleaved and L(u 2 f ) is obtained. 
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In the second half of decoding processing the 
first time, a signal obtained by interleaving the 
receive signal cya and the a priori likelihood L(u 2 ') 
obtained in the first half of decoding processing are 
5 regarded as being a new receive signal Lcya' , decoding 
is performed using Lcya' and Lcyc, and the likelihood 
(u 2 ) obtained is output. Next, the a priori likelihood 
Le(u 2 ) is found in accordance with Equation (5) and 
this is deinterleaved to obtain L(u 3 '). 

10 In the first half of decoding processing the 

second time, the receive signal Lcya and the a priori 
likelihood L(u 3 ') obtained in the second half of 
decoding processing are regarded as being a new receive 
signal Lcya' , decoding is performed using Lcya' and 

15 Lcyb, and the likelihood (u 3 ) obtained is output. Next, 
the a priori likelihood Le(u 3 ) is found in accordance 
with the above equation, this is interleaved and L(u 4 ") 
is obtained. 

In the second half of decoding processing the 

20 second time, a signal obtained by interleaving the 

receive signal cya and the a priori likelihood L(u 4 ') 
obtained in the first half of decoding processing are 
regarded as being a new receive signal Lcya' , decoding 
is performed using Lcya* and Lcyc, and the likelihood 

25 (u 4 ) obtained is output. Next, the a priori likelihood 
Le(u 4 ) is found in accordance with Equation (5) and 
this is deinterleaved to obtain L(u 5 f ). The above - 
described decoding processing is repeated. 

In accordance with the present invention, when 

30 decoding of code of a high encoding rate using 
puncturing is performed in a turbo decoder , a 
substantial encoding length can be assured and 
deterioration of characteristics prevented even if the 
length of a training portion in calculation of metrics 

35 is reduced. Furthermore, amount of calculation by the 
turbo decoder and the amount of memory used can be 
reduced. The invention therefore is ideal for 
utilization in MAP decoding by a turbo decoder or the 
like. It should be noted that the invention of this 

40 application is applicable to a MAP decoding method for 
performing not only the decoding of turbo code but also 
similar repetitive decoding processing. 

As many apparently widely different embodiments of 
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the present invention can be made without departing 
from the spirit and scope thereof, it is to be 
understood that the invention is not limited to the 
specific embodiments thereof except as defined in the 
appended claims . 



